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ABSTRACT • , 

The systems approach used at the University of 
Michigan to prepare vocational/career educators 6f Handicapped and 
nonhandicapped students is described. Activities conducted in each of 




of research design. Program implementation aspects include program 
development, research and. publications, and leadership training. 
Program evaluation is intended to provide* impact data. Three 
assessment activities are^ described: 1) an evaluation of statewide 
inservice workshops for special needs personnel; 2) a statewide needs 
assessment for administrators, supervisors, and direct service 
personnel dealing with special * needs personnel; and/ an /evaluation 
of the competency statements for a 6 combined master's degr^ program 
in vocational/special education, (CL) 
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INTRODUCTION 

'in recent years, an increasing amount of attention has been 

given to the need to. provide professional development tra > ining / for * 

educators. The passage of three major pieces of legislation,, / 
namely: 1) Title II of the Educational Amendments of 1976 (P.L. 9 1 !- 

482,): 2)' The Education of all Handicapped Children Act of 1975 

(P.L. 94-14*2): and 3) The Rehabilitation Act Amendments of' 197*4 

(P.L. 93t112), have brought about a number of changes in tlje educa- 

tional system. Therefore it has become crucial for educators to be 

presented with sound realistically planned inservice and activities 

to help tfiem cope with thes*e ongoing changes. 

Because of these major changes , a new group of. personnel has 

emerged. This group of teachers is referred to as special needs 

personnel. These are teachers who have to serve the dual role of 

providing vocational/career training to special needs student s, i.e. 

1 • \ 

handicapped, disadvantaged and persons 9f limited English-speakitfg 
ability. Researchers such as Yung et al, 1979, Crawford, 1979, 
Moorman, 1980, and Bowen, 198O, have attested to the need to provide 
professional development training to vocational teachers involved 
in serving the vocational training needs of students with special 
needs. In addition, these same researchers have acknowledged the 
role of special educators who are faced with the task of providing 
career and employability training to their except ional^ students , 
Recognizing the need to prepare appropriate, preservice and 
inservice activities for Special Needs Personnel, the'staff of f the 
Special Education \and Occupational Education Programs became increa- 
singly involved in program, development. In that light, a number *of 



systems 'approaches were examined* For example, Er&ut r .s 1967 model 

cited ten steps: -^selection of objectives design alternatives, collect 

data, build models, weight/cost , versus effectiveness^ test, for sensi- 

tivity, question assumptions, re-examine objectives, open new alterna- 
tives and formulate problems* In a similar vein, Ofiesh (1969) pro- 

posed a five step approach: specification of behavioral objectives, 

assessment of student repertories, development of instructional 

strategies, testing and revision (validation) and packaging and 
administering a validated learning system* 

In essence, a , system is a sum total of *k comples unit, working 
independently and together to serve a common purpose (Littlejohn,198l) 

After a careful examination of the preceeding models and others devel- 
oped^ by r Hatfield, 1969'and Wenrtch and Wenrich, 197-4, it was apparent 

^ / * * 

thau if properly organized, systems continuously reorganize to meet 

new -p^^lems, to examine new complexifies and to utilize ideas and 

y 

information in a renewal process. With these thoughts in mind, a 
three-stage moclel was developed as a means of providing professional 
dev^lopment training to special needs personnel. 

Figure I based on Hoellein's 1979 systems model, gi»ves an 
overview of the approach adopted .at the University of- Michigan. The 
model includes three stages: Stage I -Planning; Stage II-Implemen- 
tation and Stage III - Evaluation. This portion of the article will 
deal with those activities conducted in each stage. 




figure I — A Genera]^ Systems Approach 



This 'three stage general sy stents model was selected, ah an * 

organizational' guide to aid in providing a model for the develop- 

'ment of teacher-training consortiums.- The 'three stages of the 

* • .. 



model are: 



PROGRAM 
PLANNING 



PROGRAM 
IMPLEMENTATION 



PROGRAM 
EVALUATION 
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Administrator's Guidebook, 
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THE UNIVERSITY OP MICHIGAN PROFESSIONAL DEVELOPMENT 

I, Program Planning , ^ 

t This stage includes' the development of overall goals* and 

measureable objectives; the identification of problems 'from docu- 

mented needs; the identification ofctasks to be completed; and the 

identification of possible strategies and*tools for attaining the 

objectives. Each of the planning components should be directed 

toward meeting the needs of the training institutions, teachers 

and administrators , and students* 

-Overall goals, guidelines 

-Administrative organization 

-State 'department coordination 

-Advisory committee development 

-Identification of issues u 

. ' -Identification of target population , 

r Needs assessment 
-Cooperation w/local agencies 

-Cooperation w/out-state resources 

-Review curreAt * literature 

-Identification of research design 

-Develop implementation plan 

II. Program Implementation * 

This ,stage involves the installation of the program and the 

maintenance $nd coordination of the program components* This tenta- 

tive listing of subjects to be addressed in the program development- 

phases serve to provide a comprehensive and appropriate program 

designed to meet the individual and institutional needs- of educators 

teachers, and students, 

-Pre-service 

-In-service 
* -Inter-agency agreements 

-Materials: development and dissemination 



-Program development 
-Publicity *and infbrmation disbursement S ^ 

-Budgetary aad funding resoi^><r^s" 
% -Research and Publi^^^fis 

-Intra/Inter-s tat ^'Communications 

-Leadership training , 4 * 

III. Program Evalujatiqn . * . 

* 

'The program evaluation 'stage, is divided into two types of 

evaluation — prooess and product^ Process evaluation is ^ngoing 

assessment of the overall progrant^ that permits periodic decisions 

regarding the adequacy of the programs and services is that needed 

modifications and revisions can be made while the program is. in ' 

progress* Process evaluation ma^ be cQnducted on a course, semeste^, 
or yearly basis to provide information for program decisions. * \, 

^J^roduct evaluation is viewed as a i^rminai activity to provide. 

impact £ata. Institution, .teacher, and student follow-^p information,' 

. employer follow-up data, and cost/benefit analyses are the primary 

methods utilized in product evaluation. On the basis of the product 

evaluation, the impact of individual programs and services and the 

overall program can be determined, to provide a baseline for decisions 

regarding* future program direction and planning. The product evalua r 
tion should be designed to provide the information necessary to make 

program planning decisions such as: 1) continue present program; 

2} make specific modifications and revisions of program; or 3) ter- 

<minate the program. 

a) Process^ This stage involves the monitoring of progress in 

^ achieving program and individual program objective 
^ and in utilizing program alternative to' achieve 

obj ectives . 

b) Product; Thi*s stage includes evaluation of impact of pro- 

gram; .cost/benefit analysis; and information for 
revision of program. 



ASSESSMENT ACTIVITIES AND RESULTS 

During the process of examining both of the systems approaches, 
it was noted thjit assessment was considered to be a crucial part of 
any program .development activity. Therefore, a decision was made 
to conduct a series of assessment activities, namely: 1) An Evalu- 
ation} of State-wide Inservice workshops for Special needs Personnel; 

2) A* state-wide needs assessment for Administrators, Supervisors 
and Direct Service Personnel dealing with Special needs Personnel and 

3) An Evaluation of the Competency Statements for a combined Masters 
Degree Program in Vocational/Special Education, 

The remaining portion of this article pertains to each of those 

assessment activities conducted. The results of these activities 

served as a basis for both inservice and pre,s<ervice training actjfvi- 

ties for Special Needs Personnel. , 

AN EVALUATION' OP STATE-WIDE INSERVICE " * 

WORKSHOPS FOR SPECIAL NEEDS PERSONNEL * ' 

\ With t.he assistance of a grant received from the^Michigan 

department cST ' Education, a series of Competency - based Statewide 

f^service, workshops were planned, implemented and evaluated for 

I2|ft). Special, Needs Personnel throughout the State. One important * , 
aspect of the planning stage was the establishment of regional 

plaHr^Lng cc^mmitt ees . As a means of assessment, the planning com- 

mi tte'^- ip embers were requested to identify areas of training that 

would Useful to special needs personnel in the'ir region. 

On<I§f these needs have been identified, other areas were added* 

based on. t^e, State Departments previously stated objectives. As 

i m ■ V 

shown- irt Tab^e I, participants, w£re most interested in the follow- 

*/■ * $i 

ing topics: M teaching Strategies to Develop Self-Esteem; 



2) Bilingual Student Issues*; 3) Job Stress/Burnout; * 4) Deaf 
Studentsj The Handicapper Experience and 6) Supportive 

Services . ti ' 

It should be noted, that those workshop sess'iohs receiving the 
highest ratings welre approximately the same as those identified by 
the Planning Committees. Table II gives ah overview of the overall 1 
satisfaction with each of the regional workshops. Based on the 
evaluation results, the important role of conducting or needs assess- 
ment was again confirmed. » 
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, TABLE I.' 

Moans of Evaluation Dimensions 
Across Six Mini-Sessions with Highest Overall Rating 



(Item 5) * (Item 1) (Item 2) 

Overall Perceived Clarity of 

Titles of Mini Session Workshop Consideration Organization Objectives 4 
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n 


X 




X 


n 


Teaching Strategies to 

UCVClOp oClI-LSlCCiM 


Til 






6.77* 


65 


6.75* 


65 


Teaching. Strategies to 
Develop Sclf-Estccm 


IV 


6.82* 


11 


7.00* 


' 65 1 


^6.82* • 


11 


IMlingual Student 
Issues 




» 

6.75* 


8 • 


6.88" 


8. 


.,6.88* 


8 


3ob Stress/Turnout 


IV. 


- 6.40* 


10 


6.6'*" 


11 . 


6.50» 


10 


Deaf Students 


IV 


' 6.36" 


11 


6.36* 


.11 


5.91 


11 


The Handicappcr * 
Experience 


111, 


6.35" 


57 


6.33 


58 


6 AO*. 


58 


Supportive Services 


IV 


6.33* 


12 


6.25 


12 


6.27 


11 



« -Within the highest quartile on the dimensions 

a Mean score for this dimension . 
b 

n = number of respondents 
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Overall Satisfaction % 
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Statewide Needs Assessment for Administrators , 
Supervisors *«aQd Direct Service Personnel 

As a means o'f determining ..those areas which should receive 

» 

high priority in preservice training programs, a Statewide needs 
Assessment was conducted ^ith approximately 900 Vocational/Special 
Needs Personnel. In order to determine importance and confidence 
ratings for Michigan Personnel, the instrument developed by the 
University of Arkansas was utilized. According to Yung, et al. 
(1979), those tasks with high mean scores in terms of importance 
.should receive high priority in jireservice, training programs. On 
the otherhand, those tasks receiving a low confidence ra'ting should 
be • concentrated on inservice training programs-. . 
As shown in Table* III', a rank ordering of means revealed those 

items ranked as the highest and lowest perceived training needs for 

. _ — ii : 7 <■ 

Michigan respondents highest ranked items on the importance dimension 
concluded such areas as : * 1} establishing appropriate attitudes; 

2} developing positive attitudes; and 3) motivation and reinforce- 

merit. Lowest ranked items included: 1) Conducting task analysis; 

2) considering alternative programs, and 3) conducting and interpreting 

follow-up studies*. 

In an attempt tfc determine what areas personnel felt confident 

in performing, the following were 'among the top ^^n^d items: 1) 

establishing, attitudes; 2) referrals to counselors ^rid ^ 3 ) coopera- 

tion with support personal. As far as those items respondents felt 

the least amount of confidence in performing, the following were - 

identified: 1) -Analyzing occupational interest; 2) identifying 
. instructional materials and 3) assisting enplo'yers* and supervisors 

work effectively with special needs students. 



TABLE III 



Ten Highest and Lowest Perceived Needs of Total Population 
< For Both the Importance and Confidence Dimensions 



Importance Dimension 



Confidence Dimension 



Top Ten Ratings 



Item 



Mean 
Score 



Item 



Mean 
Score 



• Establish attitudes 4.179 

Develop positive attitudes 4.687 

Motivate students / 4.540 

'Identify services 4.476 

Cooperate support persoiinel 4.444 

Coordinate job placement* 4.307 

Identify support personnel 4.307- 

Assist employers and super- 
visors 1 4.306 

Determine materials', methodS 

etc. 4.301 

Determine career objectives 4.299 



Establish attitudes 4. 167 

Referral to counselor^ 4.044 

Coofeerate support personnel 3.883 

Maintain student Records 3.845 

Ideiyify support personnel^ ,3.788 

Develop positive attitudes 3.626 

Collaborate with others in , 

planning / *3.339 

Motivate students * ^3.540 

Make 'information available*:. 3.450 

Identify community, govern- 
ment resources * 3.418 



Conducting task analysis 

Considering- alternative 
programs 

Conducting follow-up studies 

Integrating OSHA, - safety 
and health regulations 

Develop instructional 
tfraterials 

Identify community, govern- 
mental resources 

Understand legislation *. 

Administer diagnostic assess-* 
ment 

* \ . ' 

Identify <mdio visual 

materials 4 * 

Establish program advisory 
committees 



Lowest Ten Ratings 
4;006 



3.988* 
3. $70 

3.963 

3.952 

3.928 
3.873 

3.873 

3.724 

3.642 



Analyzing occupational 
interests 

Identifying instructional 
activities 

• Assisting employers and 
supervisors 

Considering alternative 
programs 

Developing IEP • 

Conduct task analysis 

Integrate OSHA, safety and 
health regulations 

Develop instruction materials 

Identify learning diffiulties 8 

Administer diagnostic assess- 
ment 



3.096 

3.094 

3.037' 

3.100 
3.006 
3.000 

3.000 
2. '873 
2.790 

2.697 
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v Once the ^highest and lowest ranked- items were determined/, the 

differences in training needs were divided into upper and lowei? quan- 
tities. ,This enabled us- to determine differences in four categories : 

- high importance/high conf icence;. high importance/low confidence; low 

importance/ high confidence and low importance/low confidence j(See 

Table IV)* These findings, clearly indicated areas where preservice 

and inservice training\is needed in the State of Michigan. Therefore 
' • * the role of the assessment process proved to be Invaluable to our 

present and future professional development activities. 

An Evaluation of the Competency Statements .< . , t 

. for a Combined Masters* Degree Program , V 

\ ' Based on funding received from the United .States Department 

of -Education, the staff of the Occupational and Special Educatipn 

♦ 

Programs at the University of Michigan developed a 30 hour Masters 

" v Degree' Program in Vocational/Special Education. Thirteen competency 
statements were identified as the basis for the combined program'. . 

During the second year of program development J an assessment 
of "Vocational, SpjQial "and Special Needs personnel educators was 
undertaken. The purpose of -this assessment activity was to deter- 
mine: 1) the* percentage of time personnel presently spend addVes- 
sing each of the competencies; 2) The percentage of time personnel^ 
would like. to spend on eac k competency and' 3") trfiB -degree to whicfr 
respondents felt prepared to address each of the competencies,' (See 
Table V) . 

' ' ' a' 

Data analysis included a straight-forward Tanking ordering 

• > *, 

of all competencies in descending order. As revealed in Table V, 
the respondents ranked the following among the top three in terms 
of -the Amount of time they actually spend addressing the identified 
. competencies: 1) program implementation; 2) seX-role stereotyping 

. 16 



TABLE IV ' ; 

Summary -of Upper/Lower Quartile Ratings for Three Groups of 
Respondents on the Importance and Confidence Dimension 

*■>- ....... ia (i * hm » t * , 



Ratings ^ 


Administrators 


- / Supervisors.^ \ 


Direct, Service ^„ 


High Importance/Low 
Confidence* 


Determine materials, 
methods, etc, ^ 


1 None 


Coordinate job placement 


High Importance/High 
Confidence 


Establish attitudes 
Coordinate job placement 
* " Cooperate with personnel- 


Establish' attitudes 

Develop positive attitudes 

Motivate students 

Cooperate with supportive 
personnel 

^T3entifjr services 

Identify support personnel 


Establish attitudes 

Develop positive attitudes 

Motivate students 

Cooperate with supportive 
personnel 

Identify support personnel 
Referrals to counselors 


Low Imp6rtance/High 
Confidence * \ 


^Maintain sttident recbrds 

"Establish program advi- 
sory committees 


Identify community, gov- 
ernmental agencies 

Maintain student records w 


None 


Low ImportanceV^ow. 
Confidence 

* 

L 

1 

, > 

• 


Develop techniques for 
communicating with'stu- 
dent 

Conduct task analysis 

Develop instructiorial 
materials 

Administer diagnostic' 
assessment 


•Develog instructional 
materials 

Conduct task analysis 

Integrate OSHA, safety 
& heajth regulations 

Administer diagnostic 
assessment 

Establish program advi- 
sory committees 


Revise Instructional program 

Develop instrtjctional 
materials 

Integrate OSHA, safety * > 
& health regulations 

Conduct and Interpret follow- 
up studies 

• 



♦Highlighted as major inservice/preservice training need. 
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Rank Ordering, of Competent is Based on Mean Time and Corelation Coefficients between 
Actual Time Spent (x, ) 1 and ° Preparedness, and Ideal Time to Spend <xj and 
° Prepare^hess for Vocational, Special Education, and Special Need Educators 

Preparedness 



ACTUAL " 



IDEAL 



'Rank. Order Mean Time (x 1 ) Rank Order Mean Time (x 2 ) Rank Order Mean Time (x .) ^r^ 1^ 



Legislation 


8 


(1.597) 


2 


(1,456) 

* 


10 


(2.953) 


.44 

. **** 

.24 
** 


.4 

*** 

.1 


Disab jltity 
Characteristics 


9 


(1.515) 


11 N 


(1.294) 


8 


_ (3.125) 


LeSasfe Restrictive 
Program Options * 


ich 


(1.478) 


'. • ±? 


(1.427) 


9 


ft (3.057) 
J 


.33 
**** 


.2 


Interdisciplinary/ 
Interagency 


11 


(i:435) 


8 


(1.491) 


12' 


(2.906) 


.41 

**** 


.1 


Assessment 

Individualized 
£lans 


• 7 

4 


(1.668^ ' 
(1.990) 


7 
6_ 


(•1.597) 
(1.975) 


7 


(3.173) 
(3. .600) 


.34 
' **** 
.41 
**** 


.1 
.1 


Program 
Development 


2 

• 


(2.332) 


1 


(2.510) 


2. 


(3.771] 


.37 
**** 


.1 


Program * 
Implementation \ 


.1 . 

» 


(2.436) 


* 


(2.436) 


1 


- (3,885) . 


.22 
** 


• .1 


Instructional and 
Program Evaluation 


3 


^(2.042) , 


4 * 

4 


(2.071) 


4 

— r 


(3.577) \ 


.27 
*** 


.1 


Linguistic/Cultural 


1 
1 


(0.489) 


•13 


(0.665) 


13 


• 12.05.8) 


• .43 
**** 


.X 


Sex-Ro v Ie * ' . 
•Stereo taping 


• 12 " 


(0.997)' . 


- 12 ' 


(1.112) 


1L>_ ' 


(2.914) 


.44 
**** . 


.3 
*** 


Staff Development/ 
Consultation 


5. 


(1.987) 


• 1 


(2 4 133) ' , 


6. 


(3.453) . . 


.46 
**** 


.4 

*** 


Professional 
Development 




(1.971) 


'5 


(2.076) 


5 


(3.576)*" 


;3i 
*** 


.,2 
** 


w 

*< .1 • 




4 


* * • 








* 

e 




***< .01 




•\ 
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and 3) linguistic/cultural differences were among the lowest ranked. 

The three highest ranked items in terms of ideal time to addres 

i 

each competency revealed that respondents would like to spend the 

majority of their time on such task as: 1) program development; 
2) program imp 1 erne nt^€iolv^and 3) staff development. On^ the ..other- 
hand the following were amopg the lowes/ ranked items: 1) disability' 
characteristic's 2) sex-role stereotyping and 3)' linguistic/cultural 
differences. % ^ 

When examining those competencies Personnel felt most prepared 
to perform, the following were ranked the highest": 1) program im- 
plementation; 2) program development and 3) individualized plans . 
Lowest ranked Itemjk included; 1) sex-role stereotyping; ^) inter- 
disciplinary/interagency and 3-) linguistic/cultural differences. 

It was noted that respondents were consistent in indicating 
those competencies they would like to spend more or less tirte per- 
forming. It was also clear what areas respondents felt prepared to 
perform. Based on the results of .this assessment, staff was able to 

determine areas tp concentrate on in present and furture preservice 
and inservice training activities. 
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Recommendations 
The systems approach used irf this study could be of use 
to educators providing professional development training to special 
needs personnel. Therefore, the following recommendations are 
suggested for consideration for future studies. 

1. Conduct further research to determine the degree 

of overall satisfaction with preservice and i-nservitfe 
, * activities, and the utility of the systems approach; 

2. Consider the use of .planning committers throughout the % 
planning and implementation process as a form of assess-^ 
ment; / 

3. Develop a comprehensive management plan outlining activi- 
S vities to be conducted throughout the training process. 

c < ■ 

• l». Utilize needs assessment as a means of determining differ- 
ences in training needs according to role's. 
5. Conduct needs assessment activities fy> determine requi/ed 

job tasks and new areas of interest of the target population 
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